THREE DIMENSIONAL DISPLAY APPARATUS OF THE INTEGRAL PHOTOGRAPHY 

TYPE 



BACKGROUND OF THE INVENTION : 

The invention relates to a three dimensional (3D) dis- 
play of the integral photography type. 

For the display of static or dynamic 3D images only 
the holographic method and the integral photography method are 
such that, on one hand, the viewer does not need to wear glasses 
and, on the other hand, the position of the eyes with respect to 
the display is not critical in order to obtain a correct 3D 
image. 

Compared to the holographic method, the integral pho- 
tography has the advantage of a greater simplicity. 

This known integral photography method will be 
explained herein after with reference to figure 1 and figure 2. 

Figure 1 shows the principle of image, capturing. The 
image capturing equipment comprises an array 10 of holes (or ap- 
ertures) or lenses a, b, c ... At a given distance d of this 
array 10 is provided a set 12 of detectors A, B, C ... such as 
CCDs. 

Each of those detectors has a predetermined number of 
detecting elements; this predetermined number is 8 in this sim- 
plified example. To each detecting element corresponds a pixel 
of a flat surface display (for example a liquid crystal display 
LCD) 14 of the image -reproducing device represented on figure 2. 
When a CCD detecting element receives light, the corresponding 
display pixel becomes transparent with a transmission coeffi- 
cient which depends on the light intensity received by the CCD 
element . 

In the example shown on figure 1 an object point P 
illuminates the detector elements A5, B3, C2 and the object 
point Q illuminates the detector elements A7, B6 and C5 . 
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The correspondence between CCD elements and display- 
pixels is such that to each CCD detector A, B, C ... corresponds 
a reproducing section A', B 1 , C and the order of the pixels in 
each reproducing section (A 1 for example) is inverted with 
respect to the order of the CCD elements in the corresponding 
(A) CCD detector. For example on figure 1 the CCD element Al is 
on the right part of CCD detector A and, on figure 2, the corre- 
sponding pixel element A'l is on the left part of this section. 

The control of display 14 from signals provided by CCD 
12, including the inversion, is realized by a processor not 
shown on figures 1 and 2 . 

The reproducing apparatus comprises an array 16 of 
holes or apertures, or lenses (passive array) corresponding to 
the array 10 of the image -capturing device. This array 16 is 
associated to the flat surface display 14 and to a light source 
18 in such a way that light emitted by source 18 crosses the 
display 14 and, afterwards, the holes of array 16. If the array 
16 is identical to the array 10 of the capturing device and if 
the inverted relative positions of pixel elements A ! l, A 1 2, . .., 
B ! l, B ! 2, ... are the same as the relative positions of CCD ele- 
ment, Al, A2, ... Bl, B2, ... the distance d between array 16 
and display 14 is equal to the distance between array 10 and CCD 
12. 

The light rays A' 5a, B'3b, and C'2c converge virtually 
to point The light rays A' 7a, B*6b and C ! 5c converge virtu- 

ally to point Ql. The respective positions of points P± and Q± 
are exactly the same as the respective positions of original 
points P and Q. In other words the integral photography 3D dis- 
play provides a true 3D image of the original object if there is 
perfect correspondence between detecting elements and corre- 
sponding pixels of flat display, for example LCD 14. 

The arrays 10 and 16 may be replaced by arrays of 
small lenses or equivalent means. 



BRIEF SUMMARY OF THE INVENTION : 

The invention is based on the recognition that the 
position of the reproduced object, even if it corresponds 
exactly to the original position of the object, may not be the 
optimum position for the viewer. For instance, depending on the 
scene, the viewer may have the impression that the object is too 
far or too close because his eyes must accommodate according to 
the distance or because of subjective reasons. 

The image reproducing device of the invention, which 
is of the integral photography type, is characterized in that it 
comprises means for modifying the position of the reproduced 
object with respect to the device by controlling the direction 
of each light ray passing through a point of the passive array 
and through a corresponding point of the array representing the 
object . 

In a preferred embodiment, the position is the dis- 
tance to the eyes of the reproduced object and it is monitored 
by controlling the distance between the passive array of points 
and the array representing the object, such as a flat surface 
display (for example, a LCD) . 

This embodiment is particularly simple to realize. 

In an other embodiment, for controlling the direction 
of light rays, means are provided for controlling the position 
of each point of the array representing the object on the sur- 
face of this array, and/or for controlling the position of each 
point of the passive array, in the surface of this passive 
array . 

This embodiment may be used either to control the dis- 
tance of the reproduced object to the eyes (or to the arrays) 
and/or to control the position of the reproduced object in a 
direction parallel to the surface of the array representing the 
ob j ect . 
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BRIEF DESCRIPTION OF THE DRAWINGS : 

Other features and advantages of the invention will 
appear with the following description of some of its embodi- 
ments, this description being made with reference to the herein- 
appended drawings wherein: 

figure 1, already described, represents an image cap- 
turing device of the integral photography type, 

figure 2, already partly described, represents an 
image reproducing device including the improvement according to 
the invention, 

figure 3 is a schematic view of control means of the 
reproducing device of fig 2, and 

figure 4 is a block, diagram of control means of an 
image -reproducing device according to the invention. 

DESCRIPTION OF PREFERRED EMBODIMENTS : 

The image reproducing device according to the inven- 
tion comprises means for modifying the position of the object 
with respect to the device itself which comprises the flat sur- 
face display (LCD 14) and the passive array 16. 

This modification of position may be useful in several 
circumstances, for instance if the points A* 5, A ! 7, B'3, B'6, 
etc. of the flat surface display 14 do not provide the desired 
position of the object, or if the virtual object P^ does not 
appear at an optimum distance for the observer. For instance if, 
as shown on figure 2, the virtual image P x Qx is too close from 
the eyes 20, 22 of the observer it is desirable to produce a 
virtual 3D image P'Q 1 which is at a greater distance from the 
eyes . 

In this last example, and according to an embodiment, 
the distance d between the passive array 16 and the active array 
14 is increased from d to d* . 

With this increase of distance the direction of rays 
converging to Px and Q x is modified in such a way that they con- 
verge to P 1 and Q ■ , i.e. the reproduced points P^, and are 
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moved to P ! and Q' . The consequence of the increase of distance 
d is that P and Q move to a position farther to flat surface 
display 14 and passive array 16. 

In another embodiment (not shown) means are provided 
5 for modifying the relative positions of points A' 5, B'3 and C'2 
(for point P x ) in the plane of the flat surface display 14 in 
order that point P x be shifted to point P' . If the points a, b, 
c of array 16 are electronically controlled it is also possible 
to shift their relative positions in the plane of this array. 
10 The embodiment represented on figure 3 is of the first 

kind, i.e. means are provided to modify the distance between the 
array 16 and the active array or flat surface display 14 . In 
this example, the passive array is movable and the flat surface 
display is stationary. It is also possible to make the flat sur- 
15 face display movable. For certain applications this embodiment 
is preferable because the observer may not be confused by the 
movement of the array 16 which is not directly in front of his 
eyes; in other words it may be preferable to move display 14 
rather than array 16, because the display 14 is not directly 
20 seen by the observer. 

The passive array comprises, in this specific embodi- 
ment a plurality of cylindrical lenses 24 1# 24 2 , etc. 

The signals provided by the 3D image capturing unit 26 
are transferred at the input of an image processing unit 28 

2 5 which controls the flat surface display 14 in order that the 

pixels of this LCD provide the correct image of the original 
object. This processing is performed in real time, the reproduc- 
ing apparatus being for animated pictures. 

A controller 30 (figures 3 and 4) has an input 32 

3 0 receiving a signal from a manual command device 34 under the 

control of an operator who provides command signals representing 
the direction desired for the movement of the object (farther or 
closer) . 

The controller 30 is also provided with an input 36 
3 5 receiving a signal from a sensor 38 which detects the position 
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of the head (or eyes) of the observer and this controller is 
associated with computing means 40 which calculate the optimum 
position of the reproduced object, i.e. the optimum distance d, 
in view of the position of the observer's eyes detected by sen- 
5 sor 38. For instance, the calculation unit may be programmed to 
set a constant distance between the scene (object) and the ob- 
server . 
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